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THE CURRENT INADEQUACY OF A CONCEPTUAL FRAMEWORK 
ALLOWING ACCUMULATION AND SYNTHESIS OF KNOWLEDGE CONCERNING 
EDUCATIONAL CHANGE IS EVALLsTED. CONSIDERATION OF EDUCATIONAL 
CHANGE AS SCIENTIFIC KNOWLEDGE PRESUFFOSES EXPLORATION OF THE 
DIFFICULTIES THAT RESTRICT THE MEETING OF THE ACCEPTED 
SCIENTIFIC CRITERIA OF DESCRIPTION, EXPLANATION, PREDICTION, 
AND CONTROL AS VCLL AS THE SCIENTIFIC METHODOLOGICAL 
REQUIREMENTS OF OBJECTIVITY AND SKEPTICISM. WITHIN AN 

established body of scientific knowledge a structure of 

PHENOMENA IN LOGICAL RELATIONS AND A METHODOLOGY MADE UF CF 
DEFINITE RULES OF PROCEDURE CAN BE DISCERNED. WITHOUT A 
STRUCTURE OF RELATIONS AND PROCEDURAL METHODOLOGY, INQUIRIES 
MAY OR MAY NOT LINK UP WITH EACH OTHER AND RESULT IN AN 
ACCUMULATION OF FINDINGS RATHER THAN A CUMULATION CF RESULTS. 
AN INADEQUACY OF THIS NATURE IS CHARACTERISTIC OF KNOWLEDGE 
CONCERNING EDUCATIONAL CHANGE. WITHOUT CONSENSUS UPON THE 
CONCEPTUAL FRAMEWORK OF RELATIONAL AND METHODOLOGICAL FACTS, 
IT IS DIFFICULT TO FORMULATE THEORIES THAT SYNTHEL iZE LARGE 
AREAS OF WELL-ESTABLISHED FACT. THE ATTEMPT TO MAKE A SCIENCE 
OUT CF ANY SOCIAL PHENOMENA IS CONSTANTLY QUESTIONED BECAUSE 
OF THE INHERENT SUBJECTIVITY OF THE SOCIAL SCIENCES, THE 
VALUE FACTORS OF BOTH INVESTIGATOR AND INVESTIGATED 
PHENOMENA, AND THE COMPLEXITY OF GROUP DYNAMICS. A CONCEPTUAL 
FRAMEWORK FOR EDUCATIONAL CHANGE SHOULD TAKE INTO 
CONSIDERATION THESE INHERENT DIFFICULTIES OF PSYCHOLOGICAL 
AND SOCIAL PHENOMENA ANALYSIS. ITS SCIENTIFIC STUDY COULD 
PROCEED ALONG THE TWO LINES— <1> AN EXTRAPOLATION CF EXISTING 
TRENDS IN SOCIAL SUBSYSTEMS AND A SPECULATION OF 
CONSEQUENCES, AND (2) AN EMPHASIS ON CRITICISM OF WHAT HAS 
BEEN DISCOVERED, INCLUDING AN EXAMINATION OF CONSISTENCY, 
EMPIRICAL CONSEQUENCES, AND ATTEMPTS AT FALSIFICATION. <GB> 
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CRITERIA FOR THE THEORETICAL ADEQUACY OF CONCEPTUAL FRAIfillOBK 

OF PLA1CED 5DUCATI0HAL CHANGE 

Harry S. Broudy University of Illinois 

su Pr ° bl ! ,n t0 VhI:h thi# Is directed is 

Z Lt? th! V" l HO ! d ° 8ccelarata Planed change In 
nr^.1? 7 / hl f 1# f probAe “ ^causs, according to the project 

? 0r * haV * in8uffici « nt detailed knowledge about how 
change takas place, furthermore, It is asserted that many educators 
have objections to planned change In principle. 

With regard to the first point, it is argued that knowledge 
is accumulating both in the educational literature but more care 

tlcal^ada *°^ olog y* U is wich th « criteria for the theore- 

thi^n^rT^? **? conceptuai ^amework of this knowledge that 

In! k l ti TmC ^ y concerned * 1 «» sure Just what is to 
be done about the alleged inbuilt resistance to planned change 

among educators, but on a point somewhat related to it a few 

comments will be made in the course of these preliminary remarks. 

A system of scientific knowledge enables us to describe 

!?ihe!iJ!I dlC !b ! nd P ?® 8 . ibly a<mtro1 evants «fthin a given’domain 
? w Wha ^ WOUAd t&k * to achieve such knowledge about 
educational change? Obviously, if educational change wore a 

n! P !o!!? B ? ° f ^ yaiC V ^ mietr y» OT even biology there would be 
no specie 1 problem of theoretical criteria; these are well known, 

and controvert lea about them are abstruse affairs left to the 

philosophers of science. However, educational change, social 

!??!*? general, and indeed all the subjects matters dealt 

!k!!/? th ? so ? ial 8cianc€ * «re not departments of physics and 
chemistry (at least not yet), and it is not always clear as to 

tl " het ?* r ® ne can satisfy the criteria that are taken 

for granted in the natural sciences. 

th» th 2 tafora » that Part of my task is to explore 

U ! in the Way ° f ®* etin 8 criteria of 
generalisation, explanation, prediction, and control as well as 

the requirements of scientific method with regard to objectivity 

f * ith in th * fur knowledge, and skepticism 

about every candidate for that honor. P 

th* Pr ? P ° S f’ i0eS not Mke lt whet level 

p anners o*. educational change are expected to Justify the 

^ prop “‘*> * rd w h«*‘-her the etr.tegy of producing change 
Itself hae to conforn to tvae moral norm. Suppoee a theory of 

trator^aece^***?* i= Y^ lBg Uto thJ,: Actional Ltainie- 

f e accelerate change within their eysteae on the Lasle of whet 
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they believe will enhance their prestige. They believe what sub- 
consciously they would like to be the case. Change within the 
system Is therefore, b.ou-ht about most efficiently when the pro- 
posed change is presentee as appealing to their repressed desires. 
.S M.s theory or its conceptual framework theoretically adequate? 
It might turn out to be If, for example, one could successfully 
predict change states from the theory. Morally, however, the 
theory would be somewhat less than adequate, and In some societies 
t...s would render it useless; the predictions would not be success- 
nil. We have an anslogous situation in that we know what would 
kil certain viruses within the human organism but tho agent that 
would accomplish the death of the virus would also bring about 
t e death of the patient. A theory that assumed the use of this 
virus kiiier would cure the patient v.^uld be falsified forthwith 
Or suppose that some one comes up with a theory that says social 
charges come about only through the shifts of power, and that to 

is to p ! an such power transformations. To educational 
administrators committed to democratic methods of social chanqe 
such a theory might be so unacceptable as to render them hostile 

to any such planning; a Machiavellian school master might have 
no such scruples. 3 



Furthermore, changes in the educational system range from 
those that an fairly local to those that are pervasive; from 
those that leave the value schema of the system intact to those 
that disrupt it. Changes from the use of blackboards tc green- 
boards is an example "of t^e former; a change from careful and 
strict grading to no grading at all is an example of the latter. 
Local changes are rarely value disruptive, hut some pervasive 
changes may not be either, for example, the color of the boards. 



« ™V" POr r ° f thi ? dlst ' notion «s epitomized in the following 
query. Can value commitments and changes in them be studied 

lf thC anSwer is in th e negative, criteria will 

L ^ ^ tW0 ^ 0rt ? : u thOSC 9 overn ' n 9 the search for empirical 
truths about educational change, and those that measure the worth 

of the changes in themselves. If, however, the answer is In the 
affirmative, then the same criteria can serve to check the adequacy 
of statements about value as well as fact. y 



This is not the place to argue the merits of an affirmative 
or negative answer, but I take it that the criteria sought for in 
this project are for inquiries that purport to give warranted 
assertions in the manner of empirical science. To the extent 
that such inquiries can give answers to value questions— and at 
some levels they seem to be able to do so-they need not evade the 
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I happen to bellows that tha uHlnstp justification of value 
e l a l ne llaa in a theory of human nature that has Metaphysical as 
»g** — enplrioal dlanuioaa. To this extent X da net believe that 
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I. THE STRUCTURE OF SCIENTIFIC KNOWLEDGE 



Aft«r a branch of inquiry has bean developed and proved itself 
successful in helping us to understand, predict, and control a certain 
domain of phenomena, one can study its activities, oroducts, and 
agents to find out what makes them tick. Science is what these 
agents do, and scientific knowledge is that accumulation of facts 
and theories from which they work and to which they contribute. 

A well -developed science can be said to have a body of knowledge 
and by analyzing this knowledge one can discern (l) a structure moe 
up of constituents in logical relations, and (2) a methodology made 
uo of rules of procedure. Together they provide the logical criteria 
tor theoretical adequacy and for the style of inquiry. These two are 
related in that (a) in empirical sciences, at least, the Jogi al cri- 
teria call for clues to testing procedures, i.e., for making experi- 
mental methods possible, and (b) the methodology of a prosperous 
science itself becomes a warrant for the results achieved. Thus we 
rule out as unscientific, results achieved by a method that scientists 
do not approve, e.g., divine or terrestrial revelations, hunches of 
•II kinds, intuitions and insights if not confirmed by empirical tests. 



Accordingly the question: “Is X a piece of scientific knowledge?" 

can answered In terms of the structure of which X is a logical com- 
ponent or by the way in which X was arrived at, and preferably, both. 



Facts, laws, general izat ions 

There are many ways of analyzing a body of scientific knowledge 
and th« one I shall sketch makes no claims tc completeness or techni- 
cal subtlety. First of a! i , we find statements that describe 
recurring states of affairs. These are sometimes called facts 
sometime empirical general izat Ions , sometimes scientific laws/ 
Psychologically and in ordinary usage these different terms 
connote somewhat different degrees of importance and assuredness: 
a fact, for example, is regarded as given, brute, hard to change' 
independent of our wishes, tru*. This meaning is apt for the 
singular statement that describes a state of affairs unique in 
space and time, particular events, such as are reported by “The 
sky is now blue" or “John has a mole on the right side of his 
cheek." More often facts are generalizations about what a class 
of objects or events are or do. Thus we say that it is fact that 
(under standard conditions) boils at 100 degrees C., but we 
do not mean thereby any particular potful of water on any particular 

or 

A "1W sounds more Impressive and dignified then e feet. 




primarily because we usually mean b/ it a taw of nature rather 
than a less important generalization. "All cats like fish" i, a 
generalization, and so is the statement that "Water boiis at iOO°C " 
but we would not call the first a law, whereas the latter - often’ 
so regarded. On the other hand, fact has the connotation of truth, 
so that any statement, if it withstands refutation tong enough, comes 
j* c . as a fsct. Thus although the notion that a potful 

of boiling water is a whirling mass of molecules is not something 
we can observe, the scientific community is likely to regard this 
hypothesis as a fact. 

Of course, all general izat ions arise at 01 time or another out 
of the experience of some individual at a particular time, and 
presumably a good deal of human experience went over the dem before 
man began noticing that certain experiences recurred. And in 
the last analysis no scientific theory, however subtle and abstract, 
can dispense entirely with some individual having an individual 
experience such as seeing a pointer move across a line, or a squiggle 
on a screen. Yet the scientific aspect of experience does not 
really begin until generalization sets In. 

These descriptions of recurring states of affairs can take 
several forms; (a) Descriptions of invariable conjunctions of 
properties, e.g., the temperatures at which liquids boil or 
substances melt or freeze, (b) General descriptions of sequences of 
events or processes, e.g., a scarcity of goods 13 followed by infla- 
tion which is followed by lack of confidence which is followed by a 
fall in production and investment, etc., etc. (c) Descriptions of 
correlations or covariations between events or properties, eg., 
scores on mental tests vary with the class membership of pupils.’ 

These descript. ons are of varying degrees of generality. 

Boyle's law describ;ng the relationships among the volume, tempera- 
ture, and pressure of gases is more general than the law describing the 
boiling point of water, but what purports to be a description (a theory 
of now molecules behave under variations of temperature and pressure) 
is more general than either. Generality can have another meaning, some- 
what less important for scientific knowledge. A statement is more general 
than another if the second can be subsumed under the first, but not the 
first under the second. A third meaning identifies generality with the 
size of the extension of the term. Thus generalizations about water are 
applicable to more instances than those about diamonds. However, this 
last usa Is more Indicative of the usefulness of a generalization than 
of its logical power. 
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^ 0,r * precise end detailed discussion, see Ernest Nagel, 
S t^pet urp^of Science. New York: Harcourt, Brace & World, 
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Scientific statement a whatever their degree of generality 
strive to express invariance ia the fora of uniformlt las of nature 
or lews of nature, OnL *>y noting the regularities in phenomena 
can me understand end control then. If there are exceptions , they 
■■at else be explained in terms of regularities. Individual occurences 
are scientifically insignificant except es clues to regularities, 
variations as clues to invarienco. Here science and art differ 
diametrically, for in art the end produced Is highly individual, 
aad regularities are used as Instruments to achieve ^afthetic 
affects. The significance of a scientific discovery never lies in 
tfca event that occasioned it. The particular apple was inalgnlfl- 
cant eo far at Newton's discovery was concerned; any apple would 
have done as mull. 

Another characteristic of scientific generalizations is that 
tAay autt be more than enumerations, it., go beyond *11 examined 
Inst truces . "Water boils at..." is supposed to cover all appropriate 
* ? *'lSOt whether observed or not. past, present, and future. State** 
meets which cover all the examined cases are, properly speaking, 
reports of individual states of affaire spread out over spans of 
time or regions of space. Thus a survey of the salary schedules 
of all the school systems in a county la not a generalization but 
a report. It is a fact in the sense of summarizing a specific 
state of affairs. 

Once a statement goes beyond the observed cases it becomes 
vulnerable to logical questions such as : "On vhat „ round a do you 

-^rom vhat you have observed to the unobserved?" thereby oper*~ 
ing up the whole problem of Induction and its justification. We 
•hall see that in the social sciences invariance is the hardest 
criterion to meet. Statements beginning with "All" in the social 
sciences are usually false or trivial; they become rarer and rarer 
as social sclentiate become more cautions, i,e . , more scientific in 
thslr methods. This may not be i fatal flaw in social science, but 
to invoke an old cliche, it is like building a skyscraper on pilings 
that float In loosa sands of varying danaity. It can ba dona, but 
it la not assy. But I shall raturn to this point. 



Hypotheses and theories 

At a still higher level of generality a body of scientific 
knot wedge contains statements of nets of statements t fiat ere vari * 
oualy called hypo at or theories . These often have the ton rf 
description* in that, they purport, if proved adequate, to be des 
cription* of how matters stand in nature. Two features, however, 
distinguish them from the kinds of empirical general izat ions we 
h&t*9 boon describing. For one thing (a) they can ba used to explain 
the descriptions wo have called facta, and laws and (b) they contain 



'rL C * n COntal ° ® lements that are not themselves items of observation. 
fMse are often called constructs: itoms f electrons > repressed desires 

«r« all constructs Invented by a theorist to explain facts that are 
observable and lews that, although not observable themselves, are 
inferred from observable*. Thus "Water boils at 100 degrees C." is not 

observable as such; only particular volumes of water are observed in 
the boiling. 



A highly developed theory such as is found in modern physics or 
chemistry will have as constituents (1) a set of actions or ideas 
or constructs (for example, molecules, electrons, atoms, orbits; that 

have the properties needed by the theory to account for the phenomena 
to be explained. 

(2) A set of rules (operational definitions, coordinating defini- 
tions, semantic rules, epistamic correlations, rules of interpretation, 
etc.) tnat enable us to translate the basic not ion” and their relations 
into empirical procedures. Thus, according to Nagel, Niels Bohr related 
the theoretical notion of a Jump of an electron from one orbit to 
another to the experimental notion of a line on the spectrum. Galileo 
triosltted notions of acceleration, gravity, etc., into experiments 
with lean! .'o. towers, balls, etc. 

(3) Some mode of interpreting the theoretica notion in more 
concrete terms. These are usually referred to as models. 

Although not every item in the theory will be linked with tome 
experimental procedure by a correspondence rule, enough items must be 
te permit experimental testing. 

To what extant theories in the social sciences can t***e up to 
these requirements will be discussed later. 



Explanation and prediction 

A good theory, we are told, explains laws, facts and "it predicts 
und explain# In advance laws which were unknown before 

The philosophers of science have produced a vaat literature on 
this topic, but for our purpose only enough will be presented to indicate 



2«Nagel, ^ cit, pp. 90ff. provided the basis for this classi- 
fication. 

^Norman Campbell, What is Science T New Yorks Dover Publica- 
tions, Inc., 1.952, p. 87. 
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th* kind o A distinctions we have to keep in mind when assaying the 
conceptual, framework in which the problem of studying educational 
change is concerned. 

Nagel distinguished four types of explanation:^ 

^ What is to be explained is shown to follow from 
or be implied by the theory. Thus if one asks why dreams are so strange 
and disconnected, we might explain as follows: 

Whate /er threatens the personality is kept in the unconscious 
(repressed). 

A, repressed desire, to get into consciousness, muse be disguised 
(scrambled) . 

A dream is a disguised repressed desire . 

Therefore, a dream is always scrambled. or 

If a repressed desire is to get into consciousness, it must be 
disguised (scrambled) . 

A dream is a repressed d«3ire trying to get into consciousness. 

Therefore a dream is scrambled (disguised) . 

Of course, the first premise is a highly compressed version of 
the total theory, but from it flows the consequence that dreams in 
general are scrambled, and that any particular dream will be also.-' 

2. Probabilistic The premises contain a statistical assump- 
tion (or assertion) about some class of elements while the thing to 
be explained is a singular statement about 9 member of that class. 

Why is this child, and that child, and that child failing in school? 

We explain as follows: Most children who do well In school are 
good in language skills. Most culturally deprived children are not 
good in language skills. These particular children are culturally- 
deprived. Therefore, these children do poorly in school. 

The possibility is left open that some children who do well in 

school are not good in language skills, that some children who are 
culturally deprived ere, end thet some culturally deprived children 
a*** good in school. The trouble, of course, is thet we cannot predict 



^Nagel, op. cit . pp, 20-26. 

5 

Note how this theory shapes up with the three constituents 
listed above. It has the constructs or basic notions required to 
permit deduction of the phenomena, and one could easily devise 
diagrams and models that would incorporate the key notions, 3ut 
whether it has provided transformation rules for experimental 
procedure* is still open to question* especially experiments that 
eould lead to the falsification of the theory. 
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which individual chiidren will be the exceptions to the "most" 
statements, even though we might predict with a specific degree 
of confidence that for appropriate samples the generalizations will 



. . ; L H ncttona l OX teleological Tnese explanations explain 

by indicating the function or dysfunccion that a unit performs in a 
system of which it is part. Thus we explain the structure of the 
heart by showing wnat the heart * es ,n maintaining circulation of 
c oo , or, as in the telf 3 tea] explanation, we explain John’s 
presence at the airport by h,, intent to fly to New York. 



G e . netic We set out the sequence of major events throuqh 
which some earlier .rate of affairs is transformed into a later one.- 
I one asKS why schools have commencements in June and begin school 
In September, the explanation involves recounting those features 
the . grarian economy that made these states of affairs fit into the 
sequence. Genetic explanations sre complex matters, for only those 
events that are judged to have some part in causing -he result are 
selected , But what guides us in choosing the events/ Presumably 
we are guided by some generalizations about regularities the 
ehaviors or farm people and school establishments. Clearly these 
generalizations ars In all probability themselves only probable, 
so genetic explanations are less innocent than one might expect a 
simple narratipn of events to be. 



The view that explanation is no more than showing that X is 
an instance of a higher law is not jniversally accepted. Norman 
Campbell, for example, "dissent's) altogether from this opinion." 6 
For one thing, he distinguishes laws from theories. Thus Boyle's 
law and Gay-Lussac's Laws stete generalizations about the behavior 
of gases, but the Dynamical Tneory of Gases explains them. 7 

Campbell goes on to say that laws can be deduced from a theory, 
but this is only logically necessary and not sufficient for explana- 

t I no r 



"What else do we require? 
Is that, in order that a theory 
We require that it shell add to 
it adds are acceptable."® 



I think the best answer we can give 
explain, we require i t--to explain! 
our ideas, and that the Ideas which 



8 0p. ci t . , p. 80. 
7 tb!d, . p. 81. 
8 tbld.. p. 83. 
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Models 



It is for this reason perhaps that models are used to increase 
the apprehension of a theory. A model interprets a theory by 
translating it Into a machine, a diagram or some »>ther set of 
entities that arc more familiar than the theory itself. For example, 
in trying to account for social change we might theorize that change 
is a function of the conflict between the Freudian id, ego, and super- 
ego. To make the conflict more easily imaginable, we might construct 
a diagram w*th arrows representing the three forces and the* direc- 
tions, and if we postulated that somehow this iittie system i j 1 d 
always remain in equilibrium or try to restore it, we might imagine 
hew a push by the id would elicit a counter move by the ego and 
superego. Anotner model for an equilibrium system might be a 
system of pipes in which the liquid shifts as pressures are varied. 



In this connection it might be noted that when we make models 
of human behavior we are tempted to make a theory cut of the model 
rather than vice versa. Thus, because computers are based on what 
goes on in human thinking, it is easy to think of the human mind as a 
computer. Much cf the theorizing on social change is, one might guess 
more a model building venture than that of developing theory. This 
does not mean that such model building may not be suggestive and set 
off a creative process that will result in a system of ideas that will 
explain a wide variety of facts about social change. - 

Another important criterion of a good law is brought out by 
Campbell when he says: 



So far the truth of a theory has been based on two 
grounds: first, that the laws to be explained can be deduced 
from it; second, that it really explains in the sense that 
has been indicated (reduces the unfamiliar to the more famil- 
iar and therefore more intelligible). But actually there 
rs in addition, a third test of the truth of a theory, 
which is of great importance; a true theory will not only 
explain adequately the laws that it was introduced to ex- 
plain; it will also predict and explain in advance laws 
which were unknown before. All the chief theories of science 
(or at least in physics) have satisfied this test; they 



-*» * 



i 

- . A. Hayek, The Cauri ter- Revo 1 ut ion of Science , (Glencoe, Ml, 
The Free Press, 1955, p.57) holds that in social science one does 
not deal with given wholes, but that one has to "constitute these 
wholes by constructing models from the familiar elements — models 
which reproduce the structure of relationships between some of the 
many phenomena which we always simultaneously observe in real life." 
Examples of such modal s might be the economic market with its pro- 
ducts, buyers, and sailers. 



0 



have all led directly to the dlecovery of new laws which 
were unsuspected before the theory was proposed. 1C 

Prediction it* this sense is ailed with the theoretical fruit- 
fulness of a theory. Prediction is also used to refer to the 
possibility of foretelling what consequences the theory might have 
that could be tested experimentally. Further, prediction means 
foretelling the course of events so that one can control them. 

The three senses are related, although, of course, prediction does 
not insure control, e.g., we can predict eclipses of the aun but 
we cannot control them. 

Perhaps the important requirement implied by the aforegoing 
criteria of theories is that they have within them the ideas that 
have captured some pervasive character of reality --a character that 
phenomena other than the problem under investigation possesses. 

That a theory accounts for the given problem is only a beginning; 
if it cannot be extended to different problems, it is sc lent if i-* 
cally trivial, ad hoc. In the social sciences this criterion is 
especially important because it is so easy to stop with ad hoc 
explanations. That is a good reason for encouraging criticism of 
theories as soon as possible. 

It takes a genius to invent great theories. Canmbell speaking 
of Newton said: ^ 

Ar.d then the apple fell from the tre <2 The idea 

flashed on him quicker than it could be spoken. If both 
the moon and the apple are pulled toward the earth, may 
they not be pulled by the same force? May not the force 
that makes the apple "fall” be that which restrains the 
moon in its orbit? 11 

Lasaer and more numerous minds can do the criticism and testing 

including appreciative criticism which in its higher reaches is’itself 
a creative act. 

I have run through the standard discussions of the structure of 
a body of scientific knowledge, because there is no other way of 
indicating the criteria for an ideal system of knowledge. Some of 
the natural sciences approximate it and all sciences aspire to it 
including those inquiries that concern themaelves with human behav- 
iors occurring in individuals and in groups. 

whether an inquiry succaeds depends on the style of the inquiry. 



*ty>P. elt . p. 87. 
£&» ? • 101 
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the nature of the subject matter, and on the devotion of the Investi- 
gator to the problem The style of the Inquiry is usually referred 
to as N scientlfic method** and stresses objectivity on the pare- of 
■ ^ inquirer, £he replicability of the procedures used, the adherence 
to the id-al of testability, and simple honesty on the part of the 
reporter » Other criteria that are often mentioned Include consistency 
^th veil -established theory and well-established facts within the 
field of Inquiry; simplicity and parsimony. Some of these criteria 
are logical; »jm are swthodo log leal, but the degree to which they 
can be satisfied also depends on the state of the field itself. For 
example, suppose one asks whether a theory or a finding is in 
accordance with well-established fact or theory. This makes sense 
in physics and chemistry whore workers in the field agree pretty 
well as to what is well established and what is not. But suppose 
one assi this kind of question in sociology or aothropolosv or 
economics. 

Accordingly we shall now turn to the possibility and difficulty 
of approximating the ideal conditions in the social sciences. 



# 
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IX. THEORETICAL CRITERIA AND THE SOCIAL SCIENCES 

There sterns to be no generally agreed upon set of established 
facts in the field of educational change and indeed in the social 
sciences as a whole: 

It is also generally acknowledged that in the social 
sciences there is nothing quite like the almost complete 
unanimity commonly found among competent workers in the 
natural sciences as to what are matters of established 
fact, what are reaf^nably satisfactory explanations (if 
any) for the assusvid facts >. and what are some of the valid 
procedures in sound inquiry. Disagreement on such questions 
undoubtedly occurs in the natural sciences as well. But 
it is usually found at the advancing frontiers of know- 
ledge. . 2 

In their inventory of scientific findings in the behavioral 
sciences Berelson and Steiner quote from Ernest Hilgard to the effect 
that: 

the state (of factual knowledge) is not very satisfactory; 
neither is it very easy to remedy. The number of depend- 
able "facts” in the various fields of psychology are not 
very impressive. 13 

Edward Shi Is is quoted as saying: 

nothing is more necessary at present than the systematic 
collation and "shaking down" of American sociological research 
results to discover what they amount to, to weigh evidence 
on crucial problems and to see what is really known on the 
basis of adequate evidence and what is still unsettled. ^ 

I cite these remarks not to point a derisive finger at the social 
sciences but rather to bring home the point that without a solid 
backlog of established fact and theory inquiries perforce are instituted 
from a thousand viewpoints that may or may not link up with each other. 
This results in an accumulat ion of "findings" but no cumulation of 
results. There is then a kind of sociological criterion A or theoreti- 
cal adequacy of a conceptual framework, as well as logical and methodo- 
logical ones. I mean by this term the state of a field of Inquiry with 
respect to its state of maturity. This is an important factor because 



i2 Emest Nagel, The Structure of Science , p. 448. 

13 

Bernard Berelson ani Gary A, Steiner, Human Behavior . New York: 
Harcourt, Brace, & World, 1964, p. 4. Quoted from "The Present Status 
and Prospects of Psychology as a Science and as a Profession." 
UhpuDllahed mss. 1957, p. 7. 

^Ibid. , quoted from The Present State of f^rican Sociology. 
Glencoe, III.: The Free Press, 1948, p. 43, is Berelson and Ste f \sr, 
op. cit. 
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gem of tho criteria for scientific knowledge become inapplicable 
tmtll a aufficiejiv atata of Maturity la reached. 



Iba Metho dological Circle 

Wa seem to ba caught in a vicious Methodological circle. Without 
•om consensus aa to the well-established facta in tha field of inquiry 
it ia difficult to formulate or dlecover Important thaoriaa that 
woify large domains of ws 11 -established fact* Yet, without a one 
established theories, researchers have no guide as to what are the 
important facts— important in the sense of being fruitful for further 
development of knowledge. Consequently, until a field does reach a 
degree of consensus as to its important problems neither theory-building 
nor fact-gathering can progress except by shear accretion of happy 
accident or the ingresslon of a genius. 

What has been said about making positive additions and refinements 
to knowledge in the social sciences also applies to the business of 
during the field of lane duck theories and schemes that could not 
stand rigorous testing either on logical or experimental grounds 
Tha quickest way to drive a theory into doubtful repute it to show 
its inconsistency with established fact or theory . But when no such 
bench-lines are available the field remains cluttered with approaches 
and models and classifications. 

For example, there is no single scheme of classifying human motives 
although it is one of the important concepts in the behavioral sciences. 
One classification that is widely used in current research lists 28 
psychogenic needs. 15 

According to Robert Chin 16 the systems model of change utilizes the 
following major terms: System, boundary, energy interchange, tension, 

stress, strain, conflict, equilibrium, steady state, and feedback. 
Developmental models utilise the notion of direction as defined by goals, 
cr by the process of developing or maturing or movement toward some 
goal. The term "identifiable state" involves such other terms such as 
"stages," "states," "phases," and "periods." Chin notes that, "No 
uniformity exists in the definition and operational identification of 
such successive stages." 17 Alto used are terms denoting forms of pro- 
gression and forces and potantlallty. 



jL5 

A K. A. Murrey, ed.. Explorations in Personality: A Clinical 

Experimental Study of Flft yMen _of Coll e ge Aae . New York, Oxford 
University Press, 1938, p. 80-83 

16 Tha PI annlne of ffrgng*, Warren G. Bennie, Kenneth D. Benna, and 
Robert Chin, ada. Hew York: Holt, Rinehart, & Winston, 1961, pp. 201- 
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A third wodel for change "Incorporates some elements of analysis 
from tho system oodn.s, along with some Ideas from the developmental 
model. In a framework where direct attention is paid to the Induced 
forces producing change. It studies stability In order to unfreeze 
^ move some parts of the system !8 The direction of the change is 
l^ft to the choice of the cli«nt* 3 y$(:«in. 



The variety of models used to structure social change itself 
promotes wide variation in the ideas selected for basic theoretical 
units. The research consequently also becomes highly diversified in 
terminology and styles of conceptualization. 



This diversity is almost inevitable if we realize how difficult 
it is to utilize the principle of the ideal case'9 so useful in natural 
science. Unas without width, inclined planes without friction, 
falling bodies in vacuo— these Ideal situations furnished concepts 
that bora fruit In the natural sciences. But in educational change, the 
resistance to change, for example, unlike the friction on the inclined 
plane, may be the important variable. A definition that ignorM it would 
become not only practically useless but theoretically inadequate. 



Accordingly, the terms or concepts, the basic units of educational 
change tend to taka a form that enables us to identify them in ordinary 
experience. The terms "need," "role," "goal" are labels put on bins 
that contain a wide variety of items. Needs, for example, are physio- 
og cal and psychological; conscious and unconscious: real or imaqined 
individual or social. Even if we were successful in reducing the 
term no logy of hunan be! /ior to reflexes or the chemical combinations 
of elements, there would still remain the problem of the "human" 
considerations mentioned earlier. In other words, if | n principle 
nd i vi dual ity must count heavily in social changes, then theories based 
on the complete abstraction from individual i ty are "false. 11 There is 
some real doubt that we can refine our terms too much end still retain 
the problems of social change in recognizable form.^ 



Much of the research in the social sciences has gone into showing 
that certain cornnon sense generalisations can be firmed up by the proper 
scientific methodology. Consider, for example, the following generali- 
zation or finding: Whan a parson is frustrated the barrier may be 

attacked physically or symbol i cal ly. . .or if actual attack is impossible 
aggression may be displaced to an innocent but more vulnerable bystander. 21 
Or as another example of sound common sense expressed formally consider 
this statement: 



l 8 lbld .. pp. 213-214 

19 Nagel, o£. crt, pp. 505ff. 

*®Nage I , QP clt . p. 508 
21 

Serai son and Steiner, ££* eft, p. 267 
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A period of Innovation and cnange affecting an organi- 
sation Is likely to produce a heightened amount of communi- 
cation among the members, comnunlcat Ion oriented both toward 
tfi# tnk and toward mutual amot tonal support ,22 

We are told that strong informal groups within an organization, 
when hostile to its goals and methods, can effectively oppose the 
organization and that there is always a tendency for organizations 

tEl? at ,MSt P * rt,a "*' t0 tUr " -V from 

The "always" in the preceding passage promises a useful deqree 
of generality, but this is immediately dampened by the "at least 
partially" that follows. Later one reads that although "typically 
it occurs through putting means in the place of ends, procedures 
In the place of goals," there are at least a half dozen possible 
causes. The upshot of the finding Is that It covers a wide variety 
of goal-displacement, and about all one can do with this statement 
is to be on the alert for some kind of displacement if the organi- 
zation in question has been around for some time. Yet some assump- 
tions about the dynamic relations between original and displaced 

Vonl maV 66 lmportant factor ln explaining change in organiza- 



We have already noted how difficult it is to get away from 
the common sense guide to problems in the social sciences, and the 
elaborate establishment of the obvious may be a necessary stage in 
e development of knowledge about human behavior, however, this 
nuiy be more than the awkwardness due to the youth of the science. 
Now t might be possible to explain ail human behavior in terms of 
chemical reactions, but these explanations will lack any in t rest 
for us save as use of chemicals might help to control it. The 
biological regularities of hormone secretion are of great theore- 
tical interest to the biologist, but love phenomenologically is 

? ntU w ® can ffnd a hormoneal description of what it 
means to be in love with X rather than with Y and the hormonal 

state that produces happy families rather than divorces, the social 
scientist had better stick to those molar behaviors that are 



2 2 lbid ., p. 370 
22 a ibld . . p. 366 
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distinctively human. 23 

SSSSL Elections 

Can the social sciences bops to asst tbs logical and methodo- 
loglcsl criteria of scientific inquiry. I shall try to ind cate 
•<**• of the major difficulties and sons possible re joinders . 2 ^ 

Nagel raises tbs question as to why the social sciences have 
not com up with laws, generalisations, and theories that can com- 
pare vlth those in the physical sciences. 

One cluster of reasons Includes the following: 

1 • They cannot make rigorously controlled experiments . 

2. They cannot meet the requirement of varying only osn factor 
at a tins. 

3. They cannot make predictions because the factors with which 
they deal are in constant flux. 

4. The act of inquiry affects the results of the inquiry by 

(a) self -verifying prophecies or (b) by suicidal predictions. 

The general answer that Nagel makes is that the natural sciences 
have not always been able to meet sons of these requirements (e.g., 
astronomy and geology have not been able to make controlled experiments) 
and that the difficulties are not fatal. 

B*** 1 4 * rt “ opinion that with the aid of techniques of 
quantitative ana lysis of 

^ intereating to consider what would happen to the h uma n 
problem of divorce if it could be established that it was due to 
hormonal imbalance that could ba diagnosed and corrected. All the 
current causes of dlvorcs would then be explicable by hormonal 
distributions in ths partnsrs. The divorce problem would then; be 
redbeed the the problem of getting couples to undergo diagnosis 
and treatment. Just as birth control is now a problem of inple- 
mentlng what can ba accomplished. So we would transform divorce 
into a problem of attitude towards adopting the rational solution 
(which is chemical) . Suppose now that failure or willingness to 
adopt the correct attitude is shown to be reducible to the amount of 
chemical Y in the blood stream. Everything now depends on willing- 
ness to undargo the treatment for the blood, and here we reach an 
impasse unless we selzs the subject end inject Y into his blood- 
stream. 

2 Shich of what follows is indebted to Ernest Nagel's Chapters 
13 end 14 in his The St ructure of Science . Page references unless 
otherwise indicated will refer to this materiel. However, the 
treatment in this paper la not to be taken as a transcript Ion or 
summary of Nagel's views. 

t * w 



tl»« relation* of dependence between component a in various 
social processes have been made evident and have thereby 
supplied more or less firmly grounded generalized assumptions 
for explaining many features of social life, is well as 
for constructing frequency effective social policy. To 
ha sure, the laws of generalizations are far more restricted 
in scope of application, arc rormulated far less precisely... 
than are most of the commonly cited laws of the physical 
sciences. . .In these respects, however, tue generalizations 
of social inquiry do not appear to differ radically from 
generalizations currently advanced in domains usually 
regarded as unquestionably respectable subdivisions of 
natural sc lance ""for example, in the study of turbulence 
phenomena and in embryology, (p. 449), 

Another cluster of objections rises from the subjective nature of 
the subject matter of the social sciences: 

1. The subject matter ie ah'* through with human feeling and 
thought which are inherently subjective. Social facts are, therefore, 
no more than some individual's way of perceiving a situation. Social 
science, therefore, cannot lay claim to the valu^-free objectivity 
properly associated with science, especially the natural sciences. 

The attempts to objectify the subjective inner side of human life 
can take the form of art or the form of discursive knowledge. In art 
the objectification is accomplished by presenting in a sensuous image 
^ artiat's fueling about soswthing.25 in knowledge some structure 
of content is represented by a set of symbols combined into proposi- 
tions and arguments. 

In neither case does the objectification restrict itself to 
reporting the fact that X has this experience now. To art the import 
of the singular experience is the reason for its being art and consti- 
tutes its significance. The having of an experience does not tell us 
what it has in common with other experiences, but this does not in 
principle rule out the possibility of Inquiring into these similar- 
ities and in making generalizations about them. Those who argue that 
only an i ’aginative Identification with inner experience is possible 
implicitly assume that such similarities exist and are knowable. 

One must agree with Nagel when ha says that the ability of the 
social scientist 



23cf. h. S. Broudy, "The Structure of Knowledge in the Arts," in 
Education and the Structure of Kniwled^e . Stanley Siam, ed., Chicago: 
Rand McNally, 1964, pp. 75-119. 
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to enter Into relations of empathy with the human actors in 
some social process may indeed be heurlst ical ly import art 
in his efforts to invent suitable hypotheses which will 
explain the process. Nevertheless, his empathic Identifi- 
cation with these individuals does not, by itself, consti- 
tute knowledge , (p. 484) 

In other words, we don't have to be fearful to understand why a 
man is afraid just as we don’t have to be a molecule in motion to 
understand why its motions account for heat. (p. 484) Even if human 
action does have to be expicined in humanly meaningful terms these 
explanations do not require different logical canons than those re- 
quired for the "imputation of objective traits to things in other 
areas of inquiry." (p. 481) 

Vet, it must be conceded and fully recognized that "who" is 
having an experience can be more important in economics than in 
geology. Thus a banker's views on tne state of the economy is not 
to be equated with just anybody's views on the matter. The banker's 
status become.. part of the social data in a sense that the geologist's 
views about geology do not become part of the geological data. 

2. The value factors in both the investigator and the phenomena 
under investigation are so prominent in the social sciences that 
objectivity is impossible and therefore unanimity as to facts and 
theories canrot be expected. 

This objection is based not only on the subjective nature of 
Inner experience, but also on the contention that all value judgments 
are relative to the culture or aven vo a group within a culture, and 
the even stronger claim that all knowledge is ideology, that is, 
biased by the value system of an age or a culture. 26 

These objections mean that social scientists have to be especially 
sensitive to the normative componerts of their data and investigators, 
so much so that they themselves become important variables, for 
example, in current studies on the education of the culturally deprived 
child, it Is generally recognized that a nlddle-class value bias may be 
operating and ’rhis, once known, can be t en into account. However, 

In order to know that this bias operates cne has to compare the middle 
class system with value systems of otner social classet. This is quite 
possible, but having done so, we are faced with the operational neces- 
sity. of saying something about the value schema the school ought to be 
embodying. It Is at this level that the work of the social scientist 
as scientist becomes of doubtful help. 



*6for the sociology of knowledge sc* Kerl Mannheim Ideoloov end 
■Utopia . New York: Hercourt, Brace and World, 1959. ' 




A theory of cultural relativity if pushed to the exfrsrae, it 
seems to me, makes all science possible not merely social science. 

Pox if a cultural perspective :§ inevitable and distortimal, truth 
“• Principle, unattainable. If some perspectives ar better 
than others, there must be a criterion independent of these perspectives 
by which better and worse are judged. Even to note that two perspectives 
are different requires some way of making this judgment stand up, and 
if we cnn trmscend any given t**o perspectives, in principle we 
ought to he able to transcend all perspectives. If the sociology 
of knowledge is itself a correct theory, then it is so not by 

virtue of the theory of the sociology of knowledge; it must appeal 
to another criterion. 

A third type of objection is related to the ability of disabilify 
of the social sciences to generate theories that permit fruitful expira- 
tion and prediction. 



Some of the difficulties in this direction have already been 
discussed. Commenting on the increased complexity in the conceptual 
apparatus of group dynamics research Murray Horwltz notes that we 
have to take into account the effects of variables in the individual 
system on the group system and the institutional system, and that of 
tha group system on the individual and institutional systems, and 
tha institutional system on the group and individual systems. 

The variables within and among systems are all inter- 
dependent in the sense that variation within any cell may 
affect variables in the same or other cells. Indeed, a 
given change may result in chains of significant effects 
running through several cells of the matrix. This may be 
Illustrated 'by a consideration cf possible consequences 
o,. introducing 'Victim research” procedures into a group 
or institution. As these procedures have been developed iii 
ti#c. case of training groups and community self-surveys 
they entail the introduction of at least three functional roles: 
fact finding, feedback, and evaluation. Such a ch ang e in 
functional roles may produce effects within the power structure 
of the group... If evaluation is shared by the group, it enables 
w^der participation in decision making and will result, 
presumably, in greater motivation of individual members. 

The practice of fact finding so far a a it concerns other 
'groups in the environment may engender hostility toward the 
fact-finding group... 27 



vonceptuax Status of Group Dynamics" in Be^inls, Benne, Chin. 
2 £. cit, pp. 285-286. 



Y«t by the use of careful statistical techniques It Is possible to 
Identify basic relationships among some of the variables, e.g., between 
class membership and such behaviors as voting, spending, and religious 
activities; these do go beyond the deliverances of comnx>n sense. 

However, it takes an amazing amount of evidence to discourage cer- 
tain styles of inquiry. For example. 



even though there is a va»t body of research on the relation 
of teacher characteristics to effectiveness of teaching, the 
reviews of this research shows no consistent relation between 
any characteristics, including intelligence, and such teaching 

effectiveness.^ 

Whether we like it or not, we cainot controvert the fact that socia 
engineering goes on all about us, and that much of it is based on pre~ 
dictions from generalizations furnished by the social scientists in the 
form of market research, opinion polls, and the like. In principle, 
therefore, social science cannot be precluded a prio ri from coming up 
with important general* jns and theories. 

Because of its human subject matter, most of the explanations in 
the social sciences tend to be functional. An event or object is ex- 
plained functionally when its role or contribution to the maintenance 
of some system is exhibited. Two types of functionalism have bean 
distinguished; one in which the object contributes something to a 
process without any conscious intent on the agent having anything to 
dc with the process, e.g., the function of the heart. The other 
(teleological) does define function in terms of goals and purposes 
of conscious agents. It is important hi functional explanations to 
he able to specify clearly the different states of a s/stem and what 
It means to maintain them. If a system has numerous variables and 
the variables have Indefin te potential values, and if they are all 
Interrelated, the explanatory value disappears psychologically, 
and logically the theory becomes suspect because 



40 

°Berelsor. and Steiner, op . c i t . . pp. 394 . 395 , 

29 

OrvMle G. Brim, Jr., Sociology and the Field of Education. 
Russell Sega Foundation, 1958, p. 32; cited in Berelson and Steiner/op. 
ill • » P • • The persistence of the search for this will-of-the-wisp 

reflects the failure to ask why this work is so unproductive. The answer 
or at least one answer, is that good teaching is not a unitary concept 
end cannot be made so without trivallzing the results. 
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som© of these variables and constructs ar© probably gd hoc inventions 
and not supported by evidence apart from the phenomena under scrutiny. 

Aside from the complexity problem In functional explanations, 
Nagel reminds us that 

...it is hardly possible to overestimate the importance 
for the social sciences of recognizing that the imputation 
of a teleological function to a given variable must always 
be relative to some particular state in some particular 
system, and that, although a given form of social behavior 
may be functional for certain social attributes, it may 
also by dysfunctional (or even nonfunctional. In the sense 
of being causally irrelevant) for many others. 30 



General theories of soc i ety 

A larger question is whether we can generate higher order 
explanations in the form of theories about social change in general. 
The theories of Max Weber, Emile Durkhelm, Arnold Toynbee, Karl Marx 
are among the better known attempts in this field. These theories 
have from a scientific point of view not been sat i sfactory . Single 
factor theories are easily dismissed in the face of numerous counter 
examples. Where theories have yielded predictions, the events often 
did not fall out as predicted, e.g., the incidence of the proleterian 
revolution in Russia. If one multiplies the factors, the theories 
become very complicated, and it is hard to tell what is and what i« 
not implied by them. 

There are many issues involved here, but I would like to discuss 
only two: How precise must the predictions of a social theory be in 

order to have scientific value? and Must social theories be statable / 
in the categories of individual psychology or can they be stated in 
terms of sociological categories in terms of the behavior of groups? 



Hayek has argued that In some phenomena there are many variables 
some of what we have not yet identified, some of which we cannot 
d recti y observe so that predictions within a narrow rarge of space 
time, or degree cannot be expected. Nevertheless * 

...Any statement about what we will find or not find within a 
stated temporal and spatial interval is a prediction and may be 
exceedingly useful: the information that I will find no 



3®The Structure of Science , p. 532 
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in a certain journey may indeed be more important 
than the most positive statements about what I will find.^ 1 

He goes on to cite the doctrine of evolution as an example of a theory 



•••will explain or predict kinds of phenomena , defined by 
general characteristics: the occurrence , not a narrowly 

defined time and place but within a wide range, of changes 
of certain types ; or rather the absence of other types of 
changes in the structure of the succeeding organisms. ^ 

Of course, we should keep *n mind the difference between the cri- 
ticism that theories of social change have not been accurate predictors, 
and that which J?oids that in principle such theories are not verifiable 
or falsif table. On either approach, it is hard to decide whether in 
principle we can define the precise changes that such broad theories 
Imply and the boundaries of the states of the system by which the 
changes could be observed and estimated. Perhaps the conservative 
estimate of the situation is to say that cosmic theories of social 
change are premature untli well-established generalizations about 
changes within much smaller sub-systems of society are achieved, 
and these we have r»ot yet achieved. 

The second point has to do with the argument that since the data 
of the social sciences are compounded out of the actions of individual 
human beings, they should be explained by the "motivationally meaning- 
ful" categories of human experience. This view has been referred to 
as Interpretive social science (Verstehende Sozloioqic ) 33 and "metho- 
dological individual ism. "34 

Hayek says that 

...the objects of economic activity cannot be defined In 
objective terms but only wi reference to a human purpose 
goes without saying. Neither a "commodity 4 ' or an "economic 
good," nor "food" or "money," can be defined in physical 
terms but only In terms of views people hold about things... 



3, F. A. Hayek, "Degrees of Explanation," British Journal for 
Philosop hy of Science . 6:23, Novenber 1955, p. 2I&. 

3 2 lbld .. p. 220. 

. ,»r!; UdW,9 , V 2 n ”'*•*’ Theorv >nd History. New Haven: Yale University 

"ress, 195/, Pe 258. 
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'■* Unless w* can understand what the acting people mean 
by their actions any attempt to explain them, i.e., to 
subsume them under rules which connect similar situations 
with similar actions, are bound to fail. 35 

Furthermore : 

The structure of men's minds, the common principle on 
which they classify external events, provide us with the 
knowledge i c the recurrent elements of which different 
social structures ere built up and in terms of which we can 
along describe and explain them. . . ® 

A good part of the argument for Interpretive social science 
also rests on the contention that the various collective terms such 
as "society" "economic systenT"the German spirit" are not observable 
entities but constructs. Either they refer to a collection of indivi- 
duals or to something over and above these individuals, in which 
case they refer to fictions. 

Hayek's emphasis on psychological categories and the abstention 
from hypos t as iring the actions of individual men Into collective entities 
in their own right are in themselves salutary. First, they constitute 
a warning against too easily adopting mechanical models for the 
interpretation of human phenomena. Inasmuch as most machines are 
abstractive extensions of the human being's actions, (e.g., the rake, 
the plow, the lever, etc.), it is no great wonder that there will be 
similarities between men and machines, between human brains and com- 
puters. When men's values and other psychological activities are 
important variables--and in social action they almost always are--the 
machine from which such activities have deliberately been abstracted 
may no longer serve as a safe analogue for predicting what men will 
do. The eagerness with which educational researchers are snatching 
at all sorts of non-human models to find out what human beings will 
do is precisely what methodological individualism should alert us to 
and perhaps against. 

The other salutary effect is to warn against hypos tat izat ion. 

There is a difference between the statements: "The population of 

Germany is growing at the rate of so and so," and "The spirit of 
the German State demands that only Aryans hold citixenship in it." 

The first statement merely indicates that for certain purposes the 
people of Germany need not be treated as individual persons. Simi- 
larly, the statements about the coal production of the English mines 
or the gross national product are not hypos tat isat Ions in any bad 
sense. They re fer to identifiable entitles, and relations among 

35 o&. cit, p. 31. 

3 *Ibld.. pp. 33-4. 



such entitles can be studied with a profit. 

The second kind of statement can be mischievous In that It nay 
be used as a vector In social policy and can be need to sanction 
act Iona that individuals would not sanction, e.g., the doings at the 
German concentration camps. The German spirit refers to an indeter- 
minate feeling in the minds of soma men in seme moods; to base deci- 
sions or a science upon it is dangerous indeed. 

In the light of all the foregoing renarks and before summarising 
the criteria which seem to deserve special statements for the theore- 
tical adequacy of the conceptual framework for studying serial change, 

1 would like to indicate two lines of scientific activity that might 
be of profit to the field at this state of its development. 

1. One can try to extrapolate existing trends in the tioclal 
sub-systems represented by nations, industry, schools, government, 
and the like. Social science, it seems to me, can identify such 
trends as automation and urbanisation, and it can speculate care- 
fully as to what the consequences might look like. If these trends 
continue up to a stipulated time. Many of the studies already done 
might be collated and unified for such a purpose; the extrapolated 
expectations could be guides to research end plans for verifying 
predictions. Inasmuch as there will be no unanimity in the inferences 
about the co nsaquancaa of prsssnt t rands, there will be an opportunity 
for controversy and mutual criticism. This should improve the logical 
cogency end precision with which hypotheses in the social sciences are 
formulated. 

2. There is e sense in which the research task in education can 
ba divided, if we take Karl Popper's distinction between discovery 
and tasting aariously. It is difficult, perhaps impossible, to teach 
people how to make scientific discoveries, but it may be possible to 
teach a go 1 many people how to criticise whet has been discovered. 

One can learn how to deduce from e given theory (e) its logical 
implications end to exesdne them for consistency with each other end 
with other theories, (b) One can also learn to dacida whether this is 
a theory that ^ketches relations among meanings and therefore asserts 
nothing about the existential world or whether it does have empirical 
consequences , end (c) one can look for experiments or experiment -like 
inquiries to test the theory, especially tasta that would falsify it 
la tha final stap.37 

I am taken by this position because whatever theoretical difficult las 
Popper's views on induction may entail, there can ba no quarrel with its 



37 Karl Pepper* The Loaic of Scientific Discovery c Mew York; 
Basic Books, 1959* first published in German 1934* Chapter X. 
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programmatic implications for so young a venture as educational research. 
Waiting for individual researchers to evolve theories from patient piling 
up of cases In order to arrive at generalisations is a fairly futile 
affair. In apy pate It is not the way the major advances in science are 
■ade, at least not In Its early stages. 

When a discipline is well-established, many new theories are 
sloughed off because the backlog of tested theory has a presumption of 
rightness. Consistency with established theory Is therefore a crucial 
criterion. It takes a revolution in science to disturb this backlog 
and even then old theories are not so much destroyed as re- interpreted. 38 

This Is not the case In a field where not very much is well-estab- 
lished; where no agreed upon body of concepts and theory exists, end 
tdtere there is no long history of testing and refutation. 

It may well be, therefore, that we need a systematic search for 
facts that would confirm or falsify some of the theories that are 
cluttering up the research scene. These facts wili, in turn, become 
the crucial ones, the Important variables on which further research is 
to be done on which new theories will be Invented. 
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Kuhn, "Historical Structure of Scientific Discovery," 
i£jJB£S. 13 6:3$f>, Jwt. I, 19M, 760-4. 




ixi« swMunr of crueua 



This long ad r cabling discussion hot tiled to t» 3 ch on to uny 
oofacto of tho problea of theoretical criteria. A saber of such 
criteria were inforrod froa the work in tho philosophy of science 
and tho notaro of social science. Although no attenpt will bo 
■ado to conb tho dlscostion for all of thooo criteria, I bellows that 
tho following questions nay bo of soos help to thooo who are charged 
with fornulatlng tho strategy of tho project. 

1.0 How precise is tho terminology? 

1.1 Does a given concept or torn used In a study confers to 
on accepted use of tho tern by the experts In the field? 

1.2 If a different nooning froa the accepted one Is Intended, 
has tho difference boon clearly indicated? 

1.3 If a difference In nooning Is Intended, have reasons for 
the Innovation been stated? 

1.4 Is the "concept" being used in a psychological or a 
logical sense? 

1.5 Have the usual logical criteria for definitions of terns 
been observed? 

2.0 Is the given tern or terns a none for a set of observational 
data (e.g., attitudes ■ answers on an attitude Inventory), 
or is it a construct for which noonings have been stipulated 
(e.g.. Id, repression)? 

2.1 If they are nanes of observational data, have the conno- 
tation and extension of the term been node explicit? 

2.2 If the terns are constructs, have operational definitions 
been given that will enable then to be translated Into 
experlnental or observational procedures? 

2.3 Is the set of constructs sufficient to explain the phenontaa? 

2.4 Are all the constructs In the sat necessary? Can sons be 
deduced fron other nsnbers of ths swt? 

2.5 Are the concepts and constructs taken fron one system of 
Ideas (psychology) or fron nore than one? 

2.6 If the concepts are nixed, what are the logical relatione 
between then? 
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toe# a theory «nt logical and methodological uiti? 

3.1 Is there wwwt for tk thiory apart frcatto to it 
mu designed to npUlit 

3*11 I« the reasoning in it circular? 

3.12 Dns it tog tto fMiticn? 

3*13 Dots it MH tto explicamda or tot It tnUl a them? 

3.2 Have rlnl theories tom sought out end netetod for 

adequacy? 

3.3 Have tto condequences of tto ttoory toon deduced 7 

3.31 Are they toetoblo? 

3.32 Bm they toon tooted? 

* 

3.33 Bene tto really hard case* toon explained? 

3.4 Has the testing been confined to finding confirmatory 
cases, or has there toon a genuine sttenpt at testing 
that night refute tto theory? 

3.5 Have the generalisations in tto study toon over-generalized? 

3.6 Does the ttoory lend itself to being visualised by a model 
•ore concrete than tto theory itself? 

3.7 Does the mod*! spam to fit tto phenomena to which tto ttoory 
refers without gross discrepancies? 

3.8 Is tto "theory" any aore than a aodel borrowed froa seas 
other field? 

3.9 / M eve the s imil a r ities and differences between tto aodel unA 

tto phenomena been carefully scrutinised? 

3.91 Are the similarities numerous and important? 

3.92 Are tto differences irrelevant? 

4.0 To what extent have tto limitations of social inquiry as a 
science been node explicit in this Inquiry? 

4.1 2s tto hypothesis or ttoory much more complicated than tto 
rivals in tto field? Zs it so complicated that even trained 
vectors in tto field eaaaet understand it? 
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is nlttid to tmy- 
1* NHntc4 or distinguished? 



boos cm KkNqr or iapitjr 
, #f toNiy 1* impossible? 



4.3 



that knowledge la this typo 



JJ®5*^*** tako# to identify tho idiotyncrat lc factors 
tofokfy sod tho mltvral factors? 



tbs offsets of 




idlo^oeratlo factors? 



^ ^ explanation la a functional one, have the boundaries 
indicated?*** ** l * lc ^ ^ function boon clearly 

4.7 loco tho nloo assunptions of tho Inquiry boon wide explicit? 




